Replacement of physical buttons with virtual controls

ABSTRACT

In an approach for controlling a computing device without mechanical buttons the computer detects an interaction with a touch capacitive sensing surface on a computing device. The computer determines that the detected interaction includes at least three interactions including at least two different touch capacitive sensing surfaces. The computer determines a virtual control button to display based on the detected interaction. The computer displays the determined virtual control button to the user. The computer receives an interaction with the displayed virtual control button. The computer implements an action associated with the determined virtual control button based on the received interaction.

BACKGROUND

The present invention relates generally to the field of electronicdevices, and more particularly to replacing physical controls withvirtual controls of the electronic devices utilizing low capacitivesensing.

Capacitive sensing is a technology, based on capacitive coupling (i.e.,transfer of energy by displacement of a current induced by an electricfield), that detects and measures conductivity associated withconductive materials or has a dielectric (i.e., property of anelectrical insulating material) that is different from air. Capacitivesensing systems include: mutual capacitance, where an object (e.g.,finger, conductive stylus) alters mutual coupling between rows andcolumns of electrodes that are scanned sequentially; and self orabsolute capacitance, where the object loads the sensor or increases theparasitic capacitance to ground. In basic capacitive sensing technology,only one side of an insulator is coated with conductive material. Asmall voltage is applied to the conductive layer, resulting in a uniformelectrostatic field. When a conductor touches the uncoated surface, acapacitor dynamically forms. Due to the sheet resistance of the surface,each corner is measured to have a different effective capacitance. Thesensor's controller determines the location of the touch indirectly fromthe change in the capacitance as measured from the four corners of thepanel: the larger the change in capacitance, the closer the touch is tothat corner. For example, a person touches a touch a lamp that is touchsensitive. The lamp alone has a fixed capacitance, (i.e., a circuitconnected to the lamp would utilize a specified number of electrons tocharge or fill the lamp with electrons). The person also includes afixed capacitance, and when the person interacts with the lamp, thecapacitance of the person add to the capacitance of the lamp. Thecircuit connected to the lamp detects the change in capacitance andregisters the interaction.

With respect to a touchscreen, capacitive touch sensors create anelectric field above the glass of the touchscreen that are associatedwith an image map denoting a sensing region of the touchscreen. Withinthe touchscreen, sensing circuitry detects minute changes in theelectric field (i.e., changes in the touchscreen electrode's capacitancevalues) within the sensing region. Analysis and filtering of the changesin the image map result in an extraction of a signal from noise.Algorithms are applied to the signal to identify objects of interestthat interact and/or are near the surface of the touchscreen. Thecapacitive touch sensors also detect motion which is tracked withrespect to the touchscreen and the image map.

SUMMARY

Aspects of the present invention disclose a method, computer programproduct, and system for controlling a computing device withoutmechanical buttons, the method comprises one or more computer processorsdetecting an interaction with a touch capacitive sensing surface on acomputing device. The method further comprises one or more computerprocessors determining that the detected interaction includes at leastthree interactions including at least two different touch capacitivesensing surfaces. The method further comprises one or more computerprocessors determining a virtual control button to display based on thedetected interaction. The method further comprises one or more computerprocessors displaying the determined virtual control button to the user.The method further comprises one or more computer processors receivingan interaction with the displayed virtual control button. The methodfurther comprises one or more computer processors implementing, anaction associated with the determined virtual control button based onthe received interaction.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional block diagram illustrating a capacitive sensingcomputing environment, in accordance with an embodiment of the presentinvention;

FIG. 2 is a flowchart depicting operational steps of a virtual controlprogram, on a computing device within the capacitive sensing computingenvironment of FIG. 1, for replacing physical buttons with virtualcontrols for the computing device that utilizes capacitive sensing, inaccordance with an embodiment of the present invention;

FIG. 3 depicts a physical configuration of an example of a computingdevice that replaces physical buttons with capacitive sensing surfaceswithin the capacitive sensing computing environment of FIG. 1, inaccordance with an embodiment of the present invention;

FIG. 4 is a flowchart depicting additional operational steps of the stepto determine whether a motion takes place between three capacitivesurfaces within the virtual control program, in accordance with anembodiment of the present invention;

FIG. 5A depicts a mobile computing device in which the screen is set toan inactive display state, in accordance with an embodiment of thepresent invention;

FIG. 5B depicts a mobile computing device operating the virtual controlprogram that identifies an interaction with a user via the capacitivesensing surfaces via the right side of the computing device, inaccordance with an embodiment of the present invention;

FIG. 5C depicts a mobile computing device operating the virtual controlprogram that identifies the user interacts with a virtual control buttonto activate the display of the computing device, in accordance with anembodiment of the present invention;

FIG. 5D depicts a mobile computing device operating the virtual controlprogram with an active screen display on the computing device,responsive to the user interaction, in accordance with an embodiment ofthe present invention;

FIG. 6A depicts a mobile computing device in which the screen is active,in accordance with an embodiment of the present invention;

FIG. 6B depicts the mobile computing device operating the virtualcontrol program that identifies an interaction with a user via thecapacitive sensing surfaces on the left side of the computing devicethat initiates a virtual volume control button, in accordance with anembodiment of the present invention;

FIG. 6C depicts the mobile computing device operating the virtualcontrol program that identifies the user interacts with the virtualvolume control button on the computing device from the left side, inaccordance with an embodiment of the present invention;

FIG. 6D depicts a mobile computing device operating the virtual controlprogram that adjusts the virtual volume control button of the computingdevice to a lower volume in response to the user interaction, inaccordance with an embodiment of the present invention; and

FIG. 7 is a block diagram of components of the capacitive sensingcomputing device executing the virtual control program, in accordancewith an embodiment of the present invention.

DETAILED DESCRIPTION

Embodiments of the present invention recognize a computing deviceutilizes mechanical buttons (i.e., a physical switch made out of a hardmaterial such as a metal or plastic that may be moved through a changein position and/or depressed to change the state of a relay) in orderto: control one or more aspects of the computing device, initiate/changea process, and/or enter information. In addition, embodiments of thepresent invention recognize that a computing device may also utilize acapacitive sensing touchscreen and/or sensor to receive input, controlan aspect, initiate/change the process, enter information, and/or toalter a state of the computing device. Embodiments of the presentinvention recognize that the placement of the mechanical buttons on acomputing device may be limiting, awkward, decrease security options,and may accidentally initiate in response to a user interaction.Embodiments of the present invention replace mechanical buttons withcapacitive sensing surfaces that allow customization of placement andfunction or virtual buttons on a computing device. By allowing forpersonal customization by each individual user, embodiments of thepresent invention provide a more intuitive, robust, and secure computingdevice that conforms to user preferences, thereby making the computingdevice easier to use.

The present invention will now be described in detail with reference tothe Figures. FIG. 1 is a functional block diagram illustrating acapacitive sensing computing environment, generally designated 100, inaccordance with one embodiment of the present invention. FIG. 1 providesonly an illustration of one embodiment and does not imply anylimitations with regard to the environments in which differentembodiments may be implemented.

In the depicted embodiment, capacitive sensing computing environment 100includes computing device 110 and server 120 interconnected over network130. Capacitive sensing computing environment 100 may include additionalcomputing devices, mobile computing devices, servers, computers, storagedevices, or other devices not shown.

Computing device 110 may be any electronic device or computing systemcapable of processing program instructions and receiving and sendingdata utilizing touch capacitive sensing in place of mechanical buttons.In some embodiments, computing device 110 may be a laptop computer, atablet computer, a netbook computer, a personal computer (PC), a desktopcomputer, a personal digital assistant (PDA), a smart phone, a remotecontrol, a wearable device, or any programmable electronic devicecapable of communicating with network 130. In general, computing device110 is representative of any electronic device or combination ofelectronic devices capable of executing machine readable programinstructions as described in greater detail with regard to FIG. 7, inaccordance with embodiments of the present invention. In one embodiment,the body of computing device 110 comprises one or more capacitivematerials (e.g., glass, metal and glass, composite capacitive material,etc.). In another embodiment the body of computing device 110 comprisesa combination of one or more capacitive materials and one or morenon-capacitive materials (e.g., insulator, rubber, plastic, etc.).Computing device 110 contains user interface 112 and virtual controlprogram 200. Computing device 110 is described in more detail in FIG. 3.

User interface 112 is a program that provides an interface between auser of computing device 110 and a plurality of applications that resideon computing device 110 (e.g., e-mail clients, Internet browsers,voicemail, telephone, games, etc.) and/or may be accessed over network130. A user interface, such as user interface 112, refers to theinformation (e.g., graphic, text, sound) that a program presents to auser and the control sequences the user employs to control the program.A variety of types of user interfaces exist. In one embodiment, userinterface 112 is a graphical user interface. A graphical user interface(GUI) is a type of interface that allows users to interact withperipheral devices (i.e., front touchscreen 114, external computerhardware that provides input and output for a computing device, such asa keyboard and mouse) through graphical icons and visual indicators asopposed to text-based interfaces, typed command labels, or textnavigation. The actions in GUIs are often performed through directmanipulation of the graphical elements.

User interface 112 sends and receives information to virtual controlprogram 200 in response to user interactions and selections that occurvia front touchscreen 114, and/or front touchscreen 114, left capacitivesurface 116, right capacitive surface 118, top capacitive surface 122,bottom capacitive surface 124, and back capacitive surface 126. Forexample, virtual control program 200 activates user interface 112 isresponse to a combination of user interactions with front touchscreen114, left capacitive surface 116, right capacitive surface 118, topcapacitive surface 122, bottom capacitive surface 124, and backcapacitive surface 126. Virtual control program 200 receivescustomizations (e.g., activation and deactivations) of capacitivesensing areas associated with left capacitive surface 116, rightcapacitive surface 118, top capacitive surface 122, bottom capacitivesurface 124, and back capacitive surface 126 from a user via userinterface 112.

Network 130 may be a local area network (LAN), a wide area network (WAN)such as the Internet, a wireless local area network (WLAN), anycombination thereof, or any combination of connections and protocolsthat will support communications between computing device 110 and othercomputing devices and servers (not shown), in accordance withembodiments of the inventions. Network 130 may include wired, wireless,or fiber optic connections.

Virtual control program 200 is a program that replaces mechanicalbuttons with virtual controls utilizing capacitive sensing through thedevice body of computing device 110. Virtual control program 200 allowsa user to customize virtual control buttons to correspond withpreferences of the user, thereby increasing security and accessibility.In one embodiment, a user via user interface 112 customizes virtualcontrol program 200 by defining continuous motions with capacitivesurfaces and/or defining a series of multiple interactions and specifiesan action or virtual button control for control of computing device 110.In another embodiment, virtual control program 200 sets defaultcontinuous motions with capacitive surfaces and/or defining a series ofmultiple interactions assigned to an action that controls computingdevice 110 for utilization by the user (e.g., factory installedsettings). In some other embodiment, the user utilizes a combination ofcustomized and default actions to control computing device 110 viavirtual control program 200. Virtual control program 200 monitors fronttouchscreen 114, left capacitive surface 116, right capacitive surface118, top capacitive surface 122, bottom capacitive surface 124, and backcapacitive surface 126, for changes in capacitance. Upon detection of achange in the capacitance to one of front touchscreen 114, leftcapacitive surface 116, right capacitive surface 118, top capacitivesurface 122, bottom capacitive surface 124, and back capacitive surface126, virtual control program 200 continues to monitor for additionalcapacitance value changes to occur in a defined sequence (e.g., backcapacitive surface 126 to right capacitive surface 118 to fronttouchscreen 114, front touchscreen 114 to bottom capacitive surface 124to back capacitive surface 126, etc.). Virtual control program 200identifies a defined sequence of interactions that match the receivedsequence of changes in capacitance, which identifies a specific virtualcontrol for operating an aspect (e.g., power, volume, home button, backbutton, etc.) of computing device 110 previously associated with amechanical button. Virtual control program 200 displays the identifiedspecific virtual control to the user via user interface 112 for furtherutilization. In the depicted embodiment, virtual control program 200resides on computing device 110. In one embodiment, virtual controlprogram 200 is a standalone program. In another embodiment, virtualcontrol program 200 is included within user interface 112. In some otherembodiment, virtual control program 200 is included as part of theoperating system. Virtual control program 200 sends and receives virtualcontrols and information to and from user interface 112 for display anduse by a user.

An example physical configuration of computing device 110 that replacesmechanical buttons with capacitive sensing surfaces (e.g., fronttouchscreen 114, left capacitive surface 116, right capacitive surface118, top capacitive surface 122, bottom capacitive surface 124, and backcapacitive surface 126) in accordance with an embodiment of the presentinvention is depicted in FIG. 3. In one embodiment, computing device 110includes rounded edges between surfaces, in which the body of computingdevice 110 maintains a smooth uniform transition between the back,front, and sides (e.g., front, back, and sides do not exhibit a distincttransition between surfaces). For example the edges of computing device110 are beveled edges in which the edges are not perpendicular to thefaces of computing device 110. The rounded edges of computing device 110allow for a smooth single distinct motion to occur (e.g., virtualcontrol program 200 tracks a single movement between multiple capacitivesurfaces for utilization). While the rounded edges of computing device110 are continuous and/or perceived as continuous, virtual controlprogram 200 assigns a geometric plane (e.g., virtual overlay ontocomputing device 110) that distinguishes features of computing device110 associated with a front, sides, and a back surface to providedistinct selectable areas. In another embodiment, computing device 110includes defined edges that separate the front, side, and back surfaces(e.g., front, sides, and back joined by a defined angle that forms anidentifiable and distinct edge between surfaces). The defined edges ofcomputing device 110 receive individual motions respective to eachsurface over which interactions occur, which virtual control program 200evaluates and joins for utilization. In the depicted embodiment, thephysical configuration of computing device 110 includes fronttouchscreen 114, left capacitive surface 116, right capacitive surface118, top capacitive surface 122, bottom capacitive surface 124, deviceback 120, and back capacitive surface 126.

Front touchscreen 114 is a capacitive touchscreen combined with anelectronic visual display. Front touchscreen 114 registers changes inelectrical currents running through front touchscreen 114 through alayer of capacitive or electricity-storing material based on capacitorswithin front touchscreen 114. The capacitors within front touchscreen114 are arranged according to a coordinate system that creates acoordinate grid, which tracks movement and allows a user to control andmanipulate computer programs with a special stylus and/or a finger. Leftcapacitive surface 116, right capacitive surface 118, top capacitivesurface 122, bottom capacitive surface 124, and back capacitive surface126 are touch capacitive sensing surfaces that do not include a displayaspect, but include a coordinate grid system that joins with thecoordinate grid of front touchscreen 114. In the depicted embodiment,back capacitive surface 126 is a single surface the covers a portion ofdevice back 120. In another embodiment, back capacitive surface 126encompasses the entirety of device back 120. In some other embodiment,back capacitive surface 126 is divided into multiple areas (e.g.,panels, strips, smaller capacitive areas) similarly to left capacitivesurface 116, right capacitive surface 118, top capacitive surface 122,and bottom capacitive surface 124 (e.g., four individual capacitivesurfaces that coincide with device edges that are on back capacitivesurface 126).

In one embodiment the entirety of left capacitive surface 116, rightcapacitive surface 118, top capacitive surface 122, bottom capacitivesurface 124, and back capacitive surface 126 are active (i.e., virtualcontrol program 200 monitors and registers changes to capacitancevalues) in addition to front touchscreen 114 (e.g., default factorysetting by the manufacturer). In another embodiment, at least a portionof back capacitive surface 126 (e.g., bottom half, bottom quarter, lowerright quadrant, etc.) and at least a portion of one of left capacitivesurface 116, right capacitive surface 118, top capacitive surface 122,and/or bottom capacitive surface 124 are active in addition to fronttouchscreen 114. In another embodiment, the user of computing device 110via user interface 112, customizes computing device 110 and identifiesat least one of: left capacitive surface 116, right capacitive surface118, top capacitive surface 122, and bottom capacitive surface 124 asactive. For example, right capacitive surface 118 is set to active, andleft capacitive surface 116, top capacitive surface 122, and bottomcapacitive surface 124 are set to inactive. In some other embodiment,the user of computing device 110 via user interface 112 specifiesportions of at least one portion of left capacitive surface 116, rightcapacitive surface 118, top capacitive surface 122, bottom capacitivesurface 124, and back capacitive surface 126 to be active. For example auser deactivates (e.g., sets a capacitive surface to inactive and doesnot register changes in capacitance) both left capacitive surface 116,top capacitive surface 122, and the upper portion of right capacitivesurface 118 (e.g., upper half, divides the side into two equalportions). The user activates the entirety of bottom capacitive surface124, a portion of right capacitive surface 118 (e.g., bottom half of theright capacitive surface 118 which includes the bottom right corner ofcomputing device 110), and the back half (e.g., lower two quadrants) ofback capacitive surface 126. In yet some other embodiment, the user ofcomputing device 110 combines the aforementioned customizations andidentifies at least one capacitive surface and/or a portion of at leastone capacitive surface as active.

In one embodiment, left capacitive surface 116, right capacitive surface118, top capacitive surface 122, and bottom capacitive surface 124 areassigned with respect to an internal gyroscope and orientation ratherthan to an actual fixed physical configuration of computing device 110(i.e., the top, bottom, left, and right are not assigned to a specificside of computing device 110, and front touchscreen 114 changesorientation and the display viewed by the user based on the internalgyroscope). For example, a user rotates computing device 110 ninetydegrees to the right, and the long edges of computing device 110previously associated with left capacitive surface 116 and rightcapacitive surface 118 change to be associated with top capacitivesurface 122 and bottom capacitive surface 124 respectively, and theshort edges of computing device 110 previously associated with topcapacitive surface 122 and bottom capacitive surface 124 change to rightcapacitive surface 118 and left capacitive surface 116 respectively(i.e., virtual assignment of position with respect to computing device110). In another embodiment, the orientation of computing device 110 isfixed (e.g., orientation of front touchscreen 114 does not rotate withthe internal gyroscope) and left capacitive surface 116, rightcapacitive surface 118, top capacitive surface 122, and bottomcapacitive surface 124 are assigned to fixed positions (i.e., the top,bottom, right, and left designators are assigned to a specific physicallocation on computing device 110). For example, the automatic screenrotation setting is set to not rotate (e.g., disabled, set to off,etc.), therefore the display remains fixed and the display does notupdate to correspond with user movements of computing device 110.

FIG. 2 is a flowchart depicting operational steps of virtual controlprogram 200, a program for replacing mechanical buttons with virtualcontrols for computing device 110 that utilizes capacitive sensing, inaccordance with an embodiment of the present invention. Virtual controlprogram 200 is an active background application that runs continuouslywhile power is available (e.g., battery is charged, computing device 110connects to a power source for operation and/or charging) to operatecomputing device 110. As virtual control program 200 controls turning on(e.g., waking up) computing device 110 to full functionality for use bya user instead of mechanical buttons, virtual control program 200remains active while computing device 110 is placed in alternativestates by a user and/or settings associated with computing device 110(e.g., a power savings mode, turned off main functions, a hibernationmode, power off of display, etc.). In other words, a low level voltageis continuously supplied while available to maintain touch capacitivesensing and operate virtual control program 200 in order to recognizechanges in capacitance and initiate functions of computing device 110previously associated with mechanical buttons (e.g., low level power isalways on, even when computing device 110 is placed in an off state). Ifpower is not available (i.e., battery is depleted), a user connectscomputing device 110 to a power source for use and/or charges thebattery to a sufficient level prior to use in order to initiate virtualcontrol program 200 and utilize computing device 110. During regularoperation, a battery connected to computing device 110 applies a lowlevel voltage via internal circuitry to a conductive layer associatedwith front touchscreen 114, left capacitive surface 116, rightcapacitive surface 118, top capacitive surface 122, bottom capacitivesurface 124, and back capacitive surface 126, which results in a uniformelectrostatic field through with the user interacts to initiate virtualcontrol program 200.

In step 210 virtual control program 200 detects an interaction with acapacitive surface of computing device 110. Virtual control program 200monitors the capacitance levels associated with front touchscreen 114,left capacitive surface 116, right capacitive surface 118, topcapacitive surface 122, bottom capacitive surface 124, and backcapacitive surface 126 for changes. Virtual control program 200registers the change in capacitance as an interaction with a capacitivesurface. Virtual control program 200 also identifies a locationassociated with the interaction based on the coordinate grid associatedwith the capacitive surfaces of computing device 110 (e.g., backcapacitive surface 126). In one embodiment, virtual control program 200identifies a single set of coordinates associated with the interaction.For example, back capacitive surface 126 includes four separate quarterinch wide strips that follow along the edges of device back 120. A uservia user interface 112, during customization of computing device 110deactivates three of the strips, but activates the fourth strip alongthe right edge of device back 120 as back capacitive surface 126. Asonly the right edge of device back 120 is active, virtual controlprogram 200 identifies coordinates for only interactions through thequarter inch strip along the right edge of device back 120 (e.g., backcapacitive surface 126). Virtual control program 200 stores the locationof the single set of coordinates.

In another embodiment, virtual control program 200 detects multiplesimultaneous interactions and identifies multiple sets of coordinates.For example back capacitive surface 126 is active along all edges ofdevice back 120. A user picks up computing device 110, and virtualcontrol program 200 detects interactions at multiple points in which thepalm and fingers of the user are in contact with back capacitive surface126. In some embodiments, virtual control program 200 discardscoordinates and/or portions of coordinates that exceed a maximum size.For example, virtual control program 200 discards coordinates that coveran area larger than the first joint of a finger and/or exceed the widthof a finger or stylus (i.e., discards coordinates associated with pointsof contact associated with the palm of the user). In some otherembodiment, virtual control program 200 creates a map based on thecapacitance values and matches the map to stored capacitance valuesassociated with known hand positions. Utilizing the map and known handpositions, virtual control program 200 identifies which hand is holdingcomputing device 110, and discards coordinates that do not correspond toa finger. In some other embodiments, virtual control program 200discards coordinates that are not within a specified distance of an edgeof computing device back 120. For example, virtual control program 200discards coordinates that are over an inch from the edge of device back120, while maintaining coordinates that are within an inch of the edgesof device back 120. In yet some other embodiment, virtual controlprogram 200 combines one or more of the aforementioned embodiments toidentify a single set of coordinates or multiple sets of coordinates.Virtual control program 200 stores the locations of the multiple sets ofcoordinates for further utilization.

Virtual control program 200 continuously monitors the capacitivesurfaces of computing device 110 for additional interactions (e.g.,detects changes to capacitance) within a capacitive surface of computingdevice 110. For each additional interaction (i.e., identified increasein capacitance), virtual control program 200 identifies a correspondingset of coordinates associated with the location of the increase incapacitance for further utilization.

In decision 212, virtual control program 200 determines whether acapacitive surface counter is greater than zero. The capacitive surfacecounter is an integer that virtual control program 200 utilizes to track(e.g., count) the number of interactions that occur associated with adetected interaction, continuous motion and/or a series of interactions.Virtual control program 200 retrieves the capacitive surface counterassociated with the detected interaction. Virtual control program 200determines whether the value of the capacitive surface counter isgreater than zero. If virtual control program 200 determines the valueof the capacitive surface counter is not greater than zero (i.e.,capacitive surface counter is equal to zero), then virtual controlprogram 200 determines the interaction is a first interaction whichstarts a continuous motion and/or the first interaction within a definedsequence of interactions. If virtual control program 200 determines thevalue of the capacitive surface counter is greater than zero (i.e.,prior detections have occurred), then virtual control program 200determines the interaction is not a first interaction and begins furtheranalysis to determine whether the interaction is part of a continuousmotion and/or part of a defined sequence of interactions.

If virtual control program 200 determines the capacitive surface counteris greater than zero (decision 212, yes branch), then virtual controlprogram 200 determines whether a motion between three capacitivesurfaces occurs (decision 220). If virtual control program 200determines the capacitive surface counter is not greater than zero(decision 212, no branch), then virtual control program 200 incrementsthe capacitive surface counter (step 214). In step 214 virtual controlprogram 200 increases the value of the capacitive surface counter fromzero to one. Virtual control program 200 returns to detect a secondinteraction with the capacitive surfaces (step 210).

In decision 220, virtual control program 200 determines whether aninteraction between three capacitive surfaces occurs. If virtual controlprogram 200 determines the interaction between three capacitive surfacesoccurs (decision 220, yes branch), then virtual control program 200determines whether the time length of the interaction meets and/orexceeds the defined time (decision 230). If virtual control program 200determines the interaction between three capacitive surfaces does notoccur (decision 220, no branch), then virtual control program 200returns to detect an interaction (e.g., second interaction, thirdinteraction, etc.) with a capacitive surface (step 210). FIG. 4 depictsand describes the operational steps of decision 220 for determiningwhether an interaction between three capacitive surfaces occurs ingreater detail.

In decision 221, virtual control program 200 determines whether thecoordinates of the additional interaction are within the same capacitivesurface and/or surfaces as the stored interaction. Virtual controlprogram 200 identifies the coordinates of the additional interaction.Virtual control program 200 compares the coordinates of the additionalinteraction with the coordinates of the stored interaction to determinewhether the capacitive surfaces associated with the interactions are thesame. For example, the user changes a handhold by readjusting fingerplacement on the edges of computing device 110, but does not touch a newcapacitive surface of computing device 110. Therefore, virtual controlprogram 200 determines the additional interaction takes place in thesame capacitive surfaces as the stored interactions. Virtual controlprogram 200 updates the coordinates of the stored interaction tocorrespond to the updated finger placement associated with the newhandhold. In another example, the user changes handholds by rotatingcomputing device 110 ninety degrees, thereby changing finger placementfrom the long edges of computing device 110 (e.g., left capacitivesurface 116 and right capacitive surface 118) to the short edges ofcomputing device 110 (e.g., top capacitive surface 122 and bottomcapacitive surface 124). Therefore, virtual control program 200determines the additional interaction takes place in a differentcapacitive surface than the stored interactions.

Virtual control program 200 determines an interaction occurs with adifferent capacitive sensing surface upon detecting a movement withinthe geometric plane that changes from one surface (e.g., a first plane)to another surface (e.g., a second plane). For example, the geometricplane is a virtual overlay onto computing device 110 that distinguishesfeatures of computing device 110 associated with a front, sides, and aback surface to provide distinct selectable areas. As the user movesacross the geometric planes by moving a finger from the back surface tothe side, virtual control program 200 detects a change in theinteraction with the geometric planes and identifies a first interaction(e.g., portion of the geometric plane associated with the back surface)and a second interaction (e.g., portion of the geometric plane associatewith the side surface). In one embodiment, the user continues the motionand returns to the back surface. As the back surface is not the same asthe side surface within the geometric plane, virtual control program 200detects a third interaction (i.e., allows reuse of a surface within asequence of interactions and/or continuous movement). In anotherembodiment the user continues the motion to the front touchscreen, andagain virtual control program 200 detects a third interaction (i.e.,third surface is different from the first and second surfaces).Alternatively, the user continues the motion along the side surfacemoving from the middle to the top, and virtual control program 200 doesnot detect a third interaction as the interaction with the geometricplane remains within the same surface.

If virtual control program 200 determines the coordinates of theadditional interaction are within the same capacitive surface and/orsurfaces as the stored interaction (decision 221, yes branch), thenvirtual control program 200 updates the coordinates of the storedinteraction to the new coordinates (step 222). If virtual controlprogram 200 determines the coordinates of the additional interaction arenot within the same capacitive surface and/or surfaces as the storedinteraction, then virtual control program 200 determines whether theadditional interaction is part of a continuous motion (decision 223).Additionally, as the interaction does not occur in a differentcapacitive surface, virtual control program 200 does not change thevalue of the capacitive surface counter (i.e., maintains the existingvalue).

In step 222, virtual control program 200 updates the coordinates of thestored interaction to the new coordinates. Virtual control program 200utilizes the last stored set of coordinates of the stored interaction inas the basis of comparison for the subsequent determination. Uponupdating the coordinates, virtual control program 200 returns to detectan additional interaction with a capacitive surface (step 210).

In decision 223, virtual control program 200 determines whether theadditional interaction is part of a continuous motion (e.g., predefinedor user customized). Virtual control program 200 compares the stored setof coordinates with the additional set of coordinates and determineswhether the coordinates are adjacent. In one embodiment, virtual controlprogram 200 determines the coordinates are adjacent as the movement iscontinuous across multiple capacitive surfaces. For example as thefinger of the user moves between two surfaces which includes the actualor virtual edge between capacitive surfaces. Virtual control program 200tracks the coordinates of the area encompassed by the motion via thecoordinate grid. Virtual control program 200 does not identify a breakin the points of the coordinate grid traversed by the finger of the userbetween the two surfaces, and therefore virtual control program 200identifies the motion as a continuous motion between two adjacentcapacitive surfaces. In another embodiment, virtual control program 200determines the coordinates are adjacent by analyzing the coordinates ofintersecting coordinate grids. For example, when moving from ahorizontal surface to a vertical surface which an intersecting sharpedge, a slight break occurs between two sets of coordinates as the usertransitions between capacitive surfaces. Virtual control program 200analyzes the coordinates of the two points by combining the coordinategrids into a single grid from which virtual control program 200determines adjacency.

If virtual control program 200 determines that the additionalinteraction is part of a continuous motion (decision 223, yes branch),then virtual control program 200 increments the capacitive surfacecounter by one (step 225). For example, the capacitive surface counterincreases from one to two, two to three, etc., depending upon the numberof prior iterations. If virtual control program 200 determines that theadditional interaction is not part of a continuous motion (i.e.,coordinates are not adjacent), then virtual control program 200determines whether the additional interaction is part of a definedsequence of capacitive surface interactions (decision 224). For example,a user places a finger on the middle of back capacitive surface 126, butrather than sliding the finger across back capacitive surface 126 toright capacitive surface 118, the user picks up and moves the finger tothe bottom corner, which causes a break (e.g., gap, space, etc.) in thecoordinates traversed by the finger. While back capacitive surface 126is physically adjacent to right capacitive surface 118, the coordinatesare no longer directly adjacent, and therefore virtual control program200 determines the motion is not a continuous movement.

In decision 224, virtual control program 200 determines whether theadditional interaction is part of a defined sequence of capacitivesurface interactions. In one embodiment, the defined sequence ofcapacitive surface interactions are predefined (e.g., default). Inanother embodiment, the user of computing device 110 programs virtualcontrol program 200 through user interface 112 with sequences ofinteractions. The user identifies a series of interactions with thecapacitive surfaces of computing device 110 and assigns an action (e.g.,turn on display, turn off display home button, the defined sequencelinks to a specific action). By defining a series of interactions (e.g.,adjacent, non-adjacent, combination of adjacent and non-adjacent, etc.)and assigning the action to enable a function, the user increases thesecurity of computing device 110. For example another user will not haveready access to the customized sequence of interactions that enable theaction similar and therefore will not know the proper sequence ofinteractions to operate functions associated with computing device 110.

Additionally the user improves utilization by customizing a sequence ofinteractions to personal preferences. Virtual control program 200compares the location of the stored interaction and the location of theadditional interaction with stored instances of defined sequences ofmotions and/or interactions between capacitive surfaces for one or morematches (e.g., detected interactions match portions of stored userdefined sequences of interactions). For example a user defines asequence as right capacitive surface 118, then left capacitive surface116, followed by bottom capacitive surface 124 to enable the buttonassociated with the action to power on for computing device 110. Theuser defines a second sequence as left capacitive surface 116, thenright capacitive surface 118, followed by bottom capacitive surface 124with the action to display the volume control for computing device 110.While utilizing computing device 110, the user begins to enter asequence of left capacitive surface 116, then right capacitive surface118. Virtual control program 200 identifies one match (e.g., sequence todisplay the volume control) for further use in the evaluation ofadditional detected interactions. While both defined sequences includeleft capacitive surface 116, and right capacitive surface 118, virtualcontrol program 200 determines the order of the detected interactionsonly matches the order of one of the defined sequences. Continuing theexample, the user enters a sequence of left capacitive surface 116, thenright capacitive surface, and top capacitive surface 122. Virtualcontrol program 200 does not identify a match between defined sequencesand the received series of interactions. Therefore virtual controlprogram 200 determines the additional interaction is not part of adefined sequence of capacitive surface interactions.

If virtual control program 200 determines the additional interaction ispart of a defined sequence of capacitive surface interactions (decision224, yes branch), then virtual control program 200 increments thecapacitive surface counter by one (step 225). If virtual control program200 determines the additional interaction is not part of a definedsequence of capacitive surface interactions (decision 224, no branch),then virtual control program 200 resets the capacitive surface counterto one (step 226). Virtual control program 200 identifies the additionalinteraction as a first interaction of a new sequence and/or continuousmotion. Upon completion of resetting the capacitive surface counter toone, virtual control program 200 returns to detect another interactionwith a capacitive surface (step 210).

In decision 227, virtual control program 200 determines whether thecapacitive surface counter meets and/and or exceeds three. If virtualcontrol program 200 determines the capacitive surface counter meetsand/and or exceeds three (decision 227, yes branch), then virtualcontrol program 200 determines whether the time length of theinteraction meets and/or exceeds a defined time (decision 230). Ifvirtual control program 200 determines the capacitive surface counterdoes not meet and/and or exceed three (decision 227, no branch), thenvirtual control program 200 returns to detect another interaction with acapacitive surface (step 210).

In decision 230, virtual control program 200 determines whether the timelength of the interaction meets and/or exceeds a defined time. Virtualcontrol program 200 initializes and starts a timer (i.e., sets timer tozero and begins timing the length of time over which the interactionoccurs) upon detection of an interaction. The timer counts a runningtime (i.e., the clock time is real time and does not stop incrementinguntil virtual control program 200 identifies a condition occurs that isassociated with a stop condition, such as completing a sequence ofdefined interactions). Virtual control program 200 compares the runningtime with the defined time associated with the continuous motion and/orset sequence of interactions. In one embodiment, virtual control program200 utilizes a default time set by the manufacturer associated with thecontinuous motion and/or set sequence of interactions (e.g., averagetime to receive a continuous motion and/or sequence of definedinteractions). In another embodiment, virtual control program 200 setsthe defined time based on a customization identified by the user. In oneembodiment, virtual control program 200 utilizes a user customizeddefined time that is a standard time for all continuous motions and/ordefined sequences of interactions (e.g., sets a time different than thedefault). In another embodiment, virtual control program 200 utilizes auser customized defined time for each custom continuous motion and/ordefined sequence of interactions based on a time to complete eachcustomization. For example, as the user creates the custom continuousmotion and/or defined sequence of interactions, virtual control program200 records the amount of time the user takes to complete the continuousmotion and/or defined sequence of interactions. Virtual control program200 allows the user to adjust the recorded defined time and/or utilizethe recorded time for the defined time. Through virtual control program200, the user may select one or more of the following options to adjustthe default defined time, custom defined time, and/or the recordeddefined time include at least options to: identify a tolerance toidentify a minimum and maximum defined time of an interaction, reducethe defined time, and increase the defined time. Based upon thecomparison of the running time with the defined time, virtual controlprogram 200 determines whether the time length of the interaction meetsand/or exceeds a defined time.

If virtual control program 200 determines the time length of theinteraction meets and/or exceeds a defined time (decision 230, yesbranch), then virtual control program 200 resets the capacitive surfacecounter to zero (step 292). If virtual control program 200 determinesthe time length of the interaction does not meets and/or exceeds thedefined time (decision 230, no branch), then virtual control program 200displays a virtual control button (step 240).

In step 240, virtual control program 200 displays a virtual controlbutton. Virtual control program 200 identifies a virtual control buttonbased upon identifying a match between the detected interactions withthe continuous motions and/or defined sequences of interactions withinmemory. In one embodiment, virtual control program 200 identifies avirtual control button match solely based on at least three interactionswith capacitive surfaces of computing device 110 (e.g., virtual controlprogram 200 does not use exact coordinates to identify a virtual controlbutton). In other words, the user may complete the interaction from anylocation within the surfaces that define the continuous motions and/ordefined sequence of interactions, and virtual control program 200 willdisplay the same virtual control button. In another embodiment, virtualcontrol program 200 identifies a virtual control button match that isbased on at least three interactions and a fixed location (i.e., thevirtual control button is located within a specific area of computingdevice 110.) For example, the user defines a continuous motion of backcapacitive surface 126, right capacitive surface 118, and fronttouchscreen 114 within the top right half of computing device 110 toinitiate a volume control button. The user also defines a continuousmotion of back capacitive surface 126, right capacitive surface 118, andfront touchscreen 114 within the bottom right half of computing device110 to initiate a home button. Therefore, virtual control program 200identifies two possible virtual control buttons for display. To identifythe correct virtual control button, virtual control program 200 utilizesan additional location component associated with the division of thecapacitive surface to correctly identify the virtual control button.Continuing the example, the user interacts with the top right portion ofcomputing device 110, and virtual control program 200 determines theuser interaction matches the defined sequence of interactions associatedwith the volume control button.

In one embodiment, virtual control program 200 displays the virtualcontrol button to the user via user interface 112 based on thecoordinates of the last interaction (i.e., virtual control button isfluid and moves within front touchscreen 114 based on the lastinteraction and facilitates use by the user). Virtual control program200 applies an offset to the coordinates of the last interaction inorder to move the virtual control button a fixed distance from the lastinteraction. For example virtual control program 200 places the virtualcontrol button to the left of the last location of the interaction. Asvirtual control program 200 places the virtual control button next tothe last interaction, virtual control program 200 allows the user easieraccess to the virtual control button, a faster response time, andreduces accidental interactions. In another embodiment, virtual controlprogram 200 displays the virtual control button to the user via userinterface 112 based on a fixed location based on coordinates stored withthe virtual control button (i.e., virtual control program 200 displaysthe virtual control button at the same fixed location each time and doesnot utilize the location of the last interaction for display). Virtualcontrol program 200 stores the coordinates associated with the displayedvirtual control button for further utilization.

In decision 250, virtual control program 200 determines whether aninteraction occurs with the virtual control button. Virtual controlprogram 200 monitors front touchscreen 114 for a change in capacitance.Virtual control program 200 receives coordinates via the coordinate gridthat track the user interactions with front touchscreen 114. Virtualcontrol program 200 compares the coordinates of the user interactionwith the coordinates of the virtual control button. Virtual controlprogram 200 determines an interaction occurs with the virtual controlbutton when the coordinates of the user interaction intersect with thecoordinates of the virtual control button.

If virtual control program 200 determines an interaction occurs with thevirtual control butting (decision 250, yes branch), then virtual controlprogram 200 implements the interaction based on the control button (step270). If virtual control program 200 determines an interaction does notoccur with the virtual control butting (decision 250, no branch), thenvirtual control program 200 determines whether the interaction timeexpires (decision 260).

In decision 260, virtual control program 200 determines whether aninteraction time expires. The interaction time is a specified period oftime that virtual control program 200 allows to elapse while waiting toreceive a user interaction with the virtual control button. For example,upon displaying the virtual control button, virtual control program 200sets a timer equal to the interaction time of five seconds and begins acountdown of the interaction time (e.g., decrements the interactiontime). If the user does not interact with the virtual control buttonbefore the five seconds elapse (i.e., countdown of interaction timereaches zero), virtual control program 200 removes the virtual controlbutton. If the user does interact with the virtual control button withinthe five seconds (i.e., countdown of interaction time is greater thanzero), virtual control program 200 halts the countdown of theinteraction time, and stores the user interaction with the virtualcontrol button (e.g., registers a movement, selection, change in status,etc.).

In one embodiment, virtual control program 200 resumes the countdown ofthe interaction time in response to virtual control program 200determining the user is no longer interacting with the virtual controlbutton. In another embodiment, virtual control program 200 resets theinteraction time to the initial value and begins the countdown of theinteraction time again (i.e., allows the user time to change an inputvia the virtual control button.) In an alternate embodiment, virtualcontrol program 200 determines the user enters a continuous motion todisplay a different virtual control button, while waiting for theelapsed time to expire. In response, virtual control program 200 setsthe elapsed time to the maximum duration of the interaction time, whichcauses the interaction time to expire and removes the virtual controlbutton prior to displaying a new instance of a virtual control button.

If virtual control program 200 determines the interaction time expires(decision 260, yes branch), then virtual control program 200 removes thevirtual control button (step 290). If virtual control program 200determines the interaction time does not expire (decision 260, nobranch), then virtual control program 200 determines whether aninteraction occurs with the virtual control button (decision 250).

In step 270, virtual control program 200 implements the interactionbased on the virtual control button. Virtual control program 200receives the interaction of the user with the virtual control button viauser interface 112. Virtual control program 200 translates the receivedinteraction with respect to the virtual control button, and implementsthe appropriate response. In some embodiments, if virtual controlprogram 200 determines the displayed virtual control button involvesturning on power, turning off power, or turning off the display. Inresponse, virtual control program 200 sets the elapsed time to themaximum duration of the interaction time and causes the interaction timeto automatically expire and removes the virtual control button.Additionally, in an embodiment in which virtual control program 200implements an interaction to power off computing device 110 and/orrestart computing device 110 (e.g., includes a brief power off to resetcomputing device 110), virtual control program 200 completes the poweroff sequence and/or ends processing of ongoing continuous motions and/ordefined sequences of interactions (i.e., resets capacitive surfacecounter).

In decision 280 virtual control program 200 determines whether theinteraction powers off computing device 110. Virtual control program 200tracks and stores the type of virtual control button displayed and theuser interaction (e.g., selection). If virtual control program 200determines the virtual control button is associated with powering offcomputing device 110, and the user selects to power off computing device110, then virtual control program 200 implements a shutdown process andterminates ongoing processes such as processing ongoing continuousmotions and/or defined sequences of interactions. Virtual controlprogram 200 enters a minimum operational state (i.e., limited functionand lower power expenditure setting) until the user initiates acontinuous motion and/or defines sequence associated with turning oncomputing device 110. If virtual control program 200 determines thevirtual control button is any virtual control button other than poweroff computing device 110, and virtual control program 200 continuesprocessing. In an alternate embodiment, the user selects to restartcomputing device 110. Virtual control program 200 implements the poweroff process, resets the capacitive surface counter to zero (step 292),and restarts computing device 110, thus returning to detect interactionswith a capacitive surface (step 210).

If virtual control program 200 determines the interaction powers offcomputing device 110 (decision 280, yes branch), then virtual controlprogram 200 resets the capacitive surface counter to zero (step 292). Ifvirtual control program 200 determines the interaction does not poweroff computing device 110 (decision 280, no branch), then virtual controlprogram 200 determines whether an interaction time expires (decision260).

In step 290 virtual control program 200 removes the virtual controlbutton. As the virtual control button is no longer active, the user isunable to initiate changes prior to re-entering the continuous motionand/or defined sequence of interactions. Virtual control program 200displays the original image via user interface 112 without the virtualcontrol button.

In step 292, virtual control program 200 resets the capacitive surfacecounter to zero. Upon virtual control program 200 determining, the timelength of the interaction meets and/or exceeds a defined time, powersoff computing device 110, and/or removes the virtual control button,virtual control program 200 completes and therefore the continuousmotion and/or defined sequence of interaction is also complete. Virtualcontrol program 200 resets the capacitive surface counter to zero toallow for virtual control program 200 to detect a new continuous motionand/or defined sequence of interactions (i.e., begins new processing ofdetected interactions). Virtual control program 200 returns to detect aninteraction with a capacitive surface (step 210).

FIG. 5 depicts multiple examples of a user interaction with computingdevice 510 and virtual control program 200. It should be recognized thatexample FIGS. 5A-D are just a few variations of the multiple possibleconfigurations and interactions. FIG. 5A depicts mobile computingenvironment 500 operating virtual control program 200 in which computingdevice 510 is off, as noted by the lack of a visual display on fronttouchscreen 502. While mobile computing device 510 is off, the batteryof mobile computing device 510 applies a low level voltage to thecapacitive surfaces, thereby allowing virtual control program 200 todetect and respond to interactions between the user and the capacitivesurfaces. As depicted, mobile computing device 510 is held in the lefthand of the user. Virtual control program 200 detects an interactionbetween the left hand of the user and the back capacitive surface (e.g.back capacitive surface 126), which includes an interaction with finger506.

In FIG. 5B, mobile computing environment 520, the user slides finger 506from the back capacitive surface to the right capacitive surface (rightcapacitive surface 118), and then to front touchscreen 502. Virtualcontrol program 200 identifies a continuous motion that encompassesthree capacitive surfaces. Virtual control program 200 identifies thecontinuous motion as a defined sequence to power on computing device510. Virtual control program 200 displays power button 504 via fronttouchscreen 502 at the tip of finger 506. While power button 504 isplaced in close proximity to finger 506, finger 506 does not connect topower button 504 without additional movement of finger 506 by the user.

In FIG. 5C, mobile computing device 540, virtual control program 200detects finger 506 interacts with power button 504. Virtual controlprogram 200 sends a command to power on computing device 510. Uponreceipt of the power on command, virtual control program 200 sets theelapsed time to satisfy the condition in which the interaction timeexpires and virtual control program 200 removes power button 504.

In FIG. 5D, mobile computing environment 560, computing device 510completes the power on process with increased functionality and displaysthe home screen via front touchscreen 502. The user resumes holdingcomputing device 510 in the left hand and removes finger 506 from fronttouchscreen 502. Virtual control program 200 monitors for a continuousmotion and/or sequence of defined interactions to occur prior todisplaying additional virtual control buttons.

FIG. 6 depicts multiple examples of a user interaction with computingdevice 610 and virtual control program 200. It should be recognized thatexample FIGS. 6A-D are just a few variations of the multiple possibleconfigurations and interactions. FIG. 6A depicts mobile computingenvironment 600 operating virtual control program 200 in which mobilecomputing device 610 is powered on, as noted by the display of a homescreen on the front touchscreen (e.g., front touchscreen 114). Asdepicted, mobile computing device 610 is held in the left hand of theuser. Virtual control program 200 detects an interaction between theleft hand of the user and the back capacitive surface (e.g. backcapacitive surface 126), which includes an interaction with thumb 602.

In FIG. 6B, mobile computing environment 520, the user slides thumb 602from the back capacitive surface to the right capacitive surface (rightcapacitive surface 118), and then to the front touchscreen. Virtualcontrol program 200 identifies a continuous motion that encompassesthree capacitive surfaces. Virtual control program 200 identifies thecontinuous motion as a defined sequence to initiate volume control 604on computing device 610. Virtual control program 200 displays volumecontrol 604 on the left side of the front touchscreen. While volumecontrol 604 is placed in close proximity to thumb 602, thumb 602 doesnot connect to volume control 604 without additional movement of thumb602 by the user.

In FIG. 6C, mobile computing device 640, virtual control program 200detects thumb 602 interacts with volume control 604. As volume control604 is a slide motion control, virtual control program monitors thecoordinate grid for coordinate changes from the point of intersectionbetween thumb 602 and volume control 604.

In FIG. 6D, mobile computing environment 660, virtual control program200 determines the coordinate changes correspond to a decrease in volumecontrol 604. Virtual control program 200 lowers the volume and updatesthe visual component of volume control 604 to correspond to the changesin the coordinates, thereby notifying the user of receipt of the change.Once the user removes thumb 602 from volume control 604, virtual controlprogram 200 begins the elapsed time counter which must expire prior tovirtual control program 200 removing volume control 604. If the userinteracts with volume control 604 prior to the expiration of the elapsedtime, virtual control program 200 incorporates the change and resets theelapsed time counter (i.e., begins a new countdown) prior to removingvolume control 604.

FIG. 7 depicts a block diagram of components of capacitive sensingcomputing device 700, in accordance with an illustrative embodiment ofthe present invention. It should be appreciated that FIG. 7 providesonly an illustration of one implementation and does not imply anylimitations with regard to the environments in which differentembodiments may be implemented. Many modifications to the depictedenvironment may be made.

Capacitive sensing computing device 700 includes communications fabric702, which provides communications between cache 716, memory 706,persistent storage 708, communications unit 710, and input/output (I/O)interface(s) 712. Communications fabric 702 can be implemented with anyarchitecture designed for passing data and/or control informationbetween processors (such as microprocessors, communications and networkprocessors, etc.), system memory, peripheral devices, and any otherhardware components within a system. For example, communications fabric702 can be implemented with one or more buses or a crossbar switch.

Memory 706 and persistent storage 708 are computer readable storagemedia. In this embodiment, memory 706 includes random access memory(RAM) 714. In general, memory 706 can include any suitable volatile ornon-volatile computer readable storage media. Cache 716 is a fast memorythat enhances the performance of computer processor(s) 704 by holdingrecently accessed data, and data near accessed data, from memory 706.

User interface 112 and virtual control program 200 may be stored inpersistent storage 708 and in memory 706 for execution and/or access byone or more of the respective computer processor(s) 704 via cache 716.In an embodiment, persistent storage 708 includes a magnetic hard diskdrive. Alternatively, or in addition to a magnetic hard disk drive,persistent storage 708 can include a solid-state hard drive, asemiconductor storage device, a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM), a flash memory, or any othercomputer readable storage media that is capable of storing programinstructions or digital information.

The media used by persistent storage 708 may also be removable. Forexample, a removable hard drive may be used for persistent storage 708.Other examples include optical and magnetic disks, thumb drives, andsmart cards that are inserted into a drive for transfer onto anothercomputer readable storage medium that is also part of persistent storage708.

Communications unit 710, in these examples, provides for communicationswith other data processing systems or devices. In these examples,communications unit 710 includes one or more network interface cards.Communications unit 710 may provide communications through the use ofeither or both physical and wireless communications links. Userinterface 112 and virtual control program 200 may be downloaded topersistent storage 708 through communications unit 710.

I/O interface(s) 712 allows for input and output of data with otherdevices that may be connected to capacitive sensing computing device700. For example, I/O interface(s) 712 may provide a connection toexternal device(s) 718, such as a keyboard, a keypad, a touch screen,and/or some other suitable input device. External devices 718 can alsoinclude portable computer readable storage media such as, for example,thumb drives, portable optical or magnetic disks, and memory cards.Software and data used to practice embodiments of the present invention,e.g., user interface 112 and virtual control program 200, can be storedon such portable computer readable storage media and can be loaded ontopersistent storage 708 via I/O interface(s) 712. I/O interface(s) 712also connect to a display 720.

Display 720 provides a mechanism to display data to a user and may be,for example, a computer monitor.

The programs described herein are identified based upon the applicationfor which they are implemented in a specific embodiment of theinvention. However, it should be appreciated that any particular programnomenclature herein is used merely for convenience, and thus theinvention should not be limited to use solely in any specificapplication identified and/or implied by such nomenclature.

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the invention.The terminology used herein was chosen to best explain the principles ofthe embodiment, the practical application or technical improvement overtechnologies found in the marketplace, or to enable others of ordinaryskill in the art to understand the embodiments disclosed herein.

What is claimed is:
 1. A computer system for controlling a computingdevice without mechanical buttons the computer system comprising: one ormore computer processors, one or more computer readable storage media,and program instructions stored on the computer readable storage mediafor execution by at least one of the one or more processors, the programinstructions comprising: program instructions to detect an interactionwith a touch capacitive sensing surface on a computing device, whereinthe computing device includes touch capacitive sensing surfaces in placeof mechanical buttons; program instructions to determine whether thedetected interaction is a first interaction, wherein the firstinteraction starts a defined sequence of at least three interactions;responsive to determining the detected interaction is the firstinteraction, program instructions to identify the first interaction witha first touch capacitive surface of the computing device and coordinatesof the first interaction; program instructions to detect a change in thecoordinates of the first interaction; program instructions to determinewhether the change in coordinates of the first interaction are withinthe first touch capacitive sensing surface, wherein the change in thecoordinates of the first interaction is based on determining whether thefirst interaction changes from a first geometric plane to a secondgeometric plane, wherein the coordinates of the first interaction areassociated with a single set of coordinates; responsive to determiningthe change in coordinates of the first interaction are not within thefirst touch capacitive sensing surface, program instructions to identifya second interaction with a second touch capacitive sensing surface ofthe computing device and coordinates of the second interaction; programinstructions to detect a change in the coordinates of the secondinteraction; program instructions to determine whether the change incoordinates of the second interaction are within the second touchcapacitive sensing surface, wherein the change in the coordinates of thesecond interaction is based on determining whether the secondinteraction changes from one of the following: the second geometricplane to a third geometric plane, and the second geometric plane to thefirst geometric plane; responsive to determining the change incoordinates of the second interaction are not within the second touchcapacitive sensing surface, program instructions to identify a thirdinteraction with a third capacitive surface of the computing device, andcoordinates of the third interaction; program instructions to comparethe first interaction, the second interaction, and the third interactionin order with defined interactions in memory, wherein the firstinteraction, the second interaction, and the third interaction in orderform a single type of defined interaction selected from a group of typesof defined interactions stored in memory that include: a continuousmotion that includes at least three touch capacitive sensing surfacesand a sequence of defined interactions that includes a series ofseparate interactions with at least three touch sensing capacitivesurfaces, wherein the series of separate interaction includes one ormore of adjacent interactions and non-adjacent interactions, wherein thedetected interaction is a defined interaction that is a customizedpredefined interaction created by a user wherein the defined interactionlinks to a specific action that identifies a specific virtual controlfor operating an aspect of the computing device; program instructions toidentify a match between the first interaction, the second interaction,and the third interaction in order and the defined interactions inmemory based on the comparison; program instructions to determine avirtual control button based on the identified match; programinstructions to determine that a time length of the first interaction,the second interaction, and the third interaction in order at leastmeets a defined time; program instructions to display the determinedvirtual control button on the computing device in proximity to the thirdinteraction to the user; program instructions to receive an interactionwith the displayed virtual control button; and program instructions toimplement an action associated with the determined virtual controlbutton based on the received interaction.